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Abstract 

In this article, we study a single-machine scheduling problem of minimizing the total tardiness 
for a set of independent jobs. The processing time of a job is modeled as a step function of 
its starting time and a specific deteriorating date. A mixed integer programming model was 
applied to the problem and validated. Since the problem is known to be NP-hard, we proposed a 
heuristic named simple weighted search procedure (SWSP) and a general variable neighborhood 
search algorithm (GVNS). A perturbation procedure with 3-opt is embedded within the GVNS 
process in order to explore broader spaces. Extensive numerical experiments are carried out on 
some randomly generated test instances so as to investigate the performance of the proposed 
algorithms. By comparing to the results of the CPLEX optimization solver, the heuristic SWSP 
and the standard variable neighborhood search, it is shown that the proposed GVNS algorithm 
can provide better solutions within a reasonable running time. 

Keywords: single-machine scheduling, general variable neighborhood search, 
step-deterioration, total tardiness. 



1. Introduction 

As an important tool for manufacturing and engineering, scheduling has a major impact 
on the productivity of a process. In the classical model of scheduling theory, it is assumed 
that the processing times of all jobs are known in advance and remain constant during the 
entire production process. However, this assumption may not be applicable to model some 
real manufacturing and service problems. Examples can be found in steel production, equipment 
maintenance, cleaning tasks allocation and so forth (2ll[28| . where any delay or waiting in starting 
to process a job may increase the necessary time for its completion. Such kinds of jobs are called 
deteriorating jobs. This kind of scheduling problems with deteriorating jobs was firstly considered 
by Browne and Yechiali [2] and Gupta and Gupta They assumed that the processing time 
of a job is a single linearly non-decreasing function of its starting time and aimed at minimizing 
the expected makespan and the variance of the makespan in a single- machine environment. The 
function that describes the processing time of a deteriorating job shall henceforth be called a 
deterioration function. Since then, there is a rapidly growing interest in the literature to study 
various types of scheduling problems involving deteriorating jobs. A recent survey of scheduling 
problems with deteriorating jobs was provided by Cheng et al. 

Most of the research concentrated on obtaining the optimal schedule for scheduling jobs for 
which their processing times continuously depend on their starting times P, [si, 35, 17, 34, 13| . 
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However, if some jobs fail to be processed prior to a pre-specified threshold, their processing 
times will be extended by adding an extra penalty time in some situations. Job processing times 
of this type of deterioration may be characterized by a piecewise defined function. Kunnathur 
and Gupta [2l| firstly studied single-machine scheduling with a piecewise deterioration function. 
They assumed the actual processing time of a job is split into a fixed part and a variable penalty 
part. The variable part depends linearly upon the starting time of the job. Sundararaghavan 
and Kunnathur [ssj introduced a total weighted completion time scheduling problem with step 
deterioration. Then, Mosheiov [2^ investigated the scheduling problem with step deterioration 
in which the objective is to minimize the makespan on a single machine or multiple machines. 
He also introduced a simple heuristics for all these NP-hard problems. 

For the scheduling problem with a piecewise linear deterioration function, Kubiak and Van de 
Velde [231 considered single-machine scheduling with a generalization of the unbounded deteri- 
oration model proposed by Browne and Yechiali {3] and presented NP-hardness proofs. They 
also developed a pseudo-polynomial dynamic programming algorithm and a branch and bound 
algorithm to obtain the optimal schedule. Alternatively, Cheng et al. 3 studied the problem 
of scheduling jobs with piecewise linear decreasing processing times on a single or multiple ma- 
chines. They aimed to minimize the makespan and the flow time, i.e., the total completion 
time, and proved that the two problems are NP-hard. Subsequently, Ji and Cheng jl6j gave 
a fully polynomial time approximation scheme for the same case with a single-machine. After- 
wards, Wu et al. [3^ provided two heuristic algorithms to solve the single-machine problem under 
the piecewise linear deterioration model. Moslehi and Jafari [s^ dealt with the single-machine 
scheduling problem with the assumption of piecewise-linear deterioration. They suggested a 
branch and bound algorithm and a heuristic algorithm with complexity O(n^) for the objective 
of minimizing the total number of tardy jobs, where n is the total number of jobs in the problem. 

Some articles focused on the scheduling problem with step-deterioration have been published. 
Cheng and Ding Q studied some single-machine scheduling problems and showed that the flow 
time problem is NP-complete. Jeng and Lin [l^l introduced a branch and bound algorithm for 
the single- machine problem of minimizing the makespan. In addition. They also studied the 
same problem for minimizing the flow time (l5| . He et al. proposed an exact algorithm 
to solve most of the problems with up to 24 jobs and a heuristic algorithm to derive a near- 
optimal solution. Layegh et al. [22 1 minimized the total weighted completion time by using a 
memetic algorithm. Cheng et al. [6| developed a variable neighborhood search to minimize the 
flow time on parallel machines. Furthermore, batch scheduling with step-deterioration has got 



attentions |24l. |27|. However, the total tardiness as one important objective in practice has not 



been concerned on the studies of single-machine scheduling problem with step- deterioration. 

Minimizing total tardiness has been drawing considerable attentions of researchers in the past 
decades and it is NP-hard in the strong sense The latest theoretical developments for the 
single-machine scheduling problem and the current state-of-the-art algorithms are reviewed by 
Koulamas [l9'|. He found that the single-machine total tardiness scheduling problem continues 
to attract researchers' interests from both theoretical and practical perspectives. In this article, 
we consider the single-machine total tardiness scheduling problem with step- deteriorating jobs. 
Since the total tardiness problem without step-deterioration in a single-machine is a NP-hard 
problem, the problem tackled here is also a NP-hard problem. To the best of our knowledge, 
there is no literature on minimizing the total tardiness in a single-machine scheduling problem 
with step-deteriorating jobs. 

The remainder of the study is organized as follows. Section [5] contains the problem descrip- 
tion and a mixed integer programming model. In Section |3l a heuristic and a general variable 
neighborhood search algorithm are developed for the proposed problem. The proposed methods 
are tested and compared to the CPLEX and the variable neighborhood search (VNS) on variance 
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test instances of both small size and large size in Section 2] In the last section, conclusions and 
future works are mentioned. 



2. Problem formulation 

The single-machine total tardiness scheduling problem with step deteriorating jobs can be 
described as follows. Let N := {1,2,..., n} be the set of n jobs to be scheduled on a single- 
machine without preemption. Assume that all jobs are ready at time zero and the machine is 
available at all times. In addition, the machine can handle only one job at a time, and cannot keep 
idle until the last job assigned to it is processed and finished. For each job j e N, there is a basic 
processing time aj, a due date dj and a given deteriorating threshold, also called deteriorating 
date hj. If the starting time Sj of job j G iV is less than or equal to the given threshold hj, 
then job j only requires a basic processing time Oj. Otherwise, an extra penalty bj is incurred. 
Thus, the actual processing time pj of job j can be defined as a step- function: pj = aj if Sj ^ hj] 
Pj ~ Oj + &j, otherwise. Without loss of generality, the four parameters Oj, bj, dj and hj are 
assumed to be integers. 

Let TT = (tti, . . . ,7r„) be a sequence that arranges the current processing order of jobs in N, 
where ir^, k ~ 1, . . . ,n, indicates the job in position k. The tardiness Tj of a job j in a schedule tt 
can be calculated by Tj — max{0, Sj -\- pj—dj}. The objective is to find a schedule tt* such that 
the total tardiness ^ Tj is minimized. The total tardiness is a non-decreasing criterion of the 
job completion times. Using the three-field notation, this problem can be denoted by l\pj — Oj 
or ttj + bj,h-j\J2Tj. 

Based on the above description, we formulate the problem as a 0-1 integer programming 
model. Firstly, the decision variable yij, i,j^N is defined such that yij is 1 if job i is scheduled 
before job j on the single- machine, and otherwise. For each pair of jobs i and j, yij + yji — 1. 
Then, for a schedule tt of the jobs in N , we minimize 



Z(7r):=^T, (2.1) 



subject to 



Pj = VjeiV (2.2) 

I flj + bj , otherwise, 

s^+p^ ^ Sj+M{l-y,,), Wt,jEN,i^j (2.3) 

Sj+pj~d^ s; Tj, yjeN (2.4) 

y,, G {0,1}, Vz,ie7V,*^j (2.5) 

s,,T, > 0, yjeN, (2.6) 

where M is a large positive constant such that A/ — > cx) as n — > oo. For example, AI may be 
chosen as M :— maxj^jy {dj} + X]jeJv('^i + ^i) • 

In the above mathematical model, equation (j2.ip represents the objective of minimizing 
the total tardiness. Constraint (12. 2p defines the processing time of each job. Constraint (|2.3p 
determines the starting time Sj of job j with respect to the decision variables yij. Constraint 
(|2.4p defines the tardiness of job j. Finally, constraints (|2.5p and (|2.6p define the boundary values 
of variables yij, Sj, Tj, for i,j G N. 
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3. Solution methodologies 

Due to the NP-hardness of the considered problem, only small size instances can be solved 
optimally by the enumeration techniques such as branch and bound or dynamic programming. 
However the size of some practical problem encountered in industry is usually large. We need to 
develop feasible heuristics to deal with large-sized instances. In this section, a simple weighted 
search procedure and a general variable neighborhood search algorithm are proposed. 

Before introducing the algorithms, we discuss two properties of the considered problem that 
will be used later. 

Property 3.1. Consider any two jobs j and k that are processed before their given deteriorating 
dates. If Pj < Pk o,nd dj < dk, then job j must be scheduled before job k in an optimal sequence. 

Proof. Since the two jobs under consideration are not deteriorated, their processing times are 
only the basic processing times. Note that they remain to be not deteriorated even if the order 
of processing of the two jobs is switched. Lemma 3.4.1 [32:, p. 51] regarding the total tardiness 
problem in a single-machine environment says if pj ^ p^ and dj ^ d^ then there exists an optimal 
sequence in which job j is scheduled before job k. Thus, applying this Lemma based on the basic 
processing times and the due dates yields the optimal sub-sequence including the job pair (j, k) 
in an optimal schedule. □ 

Property 3.2. Consider any two jobs j and k that are processed after their given deteriorating 
dates. If Pj -f bj < Pk + bk and dj < dk, then job j should be scheduled before job k in an optimal 
sequence. 

Proof. Since the two jobs j and k are processed after their deteriorating times, the actual pro- 
cessing time of each job is the sum of its basic processing time and a penalty time. Thus, like 
Propertv l3.11 Propertv l3.2l is a direct result of applying Lemma 3.4.1 of [32|] to all such job pairs 
(j, k) based on their actual processing times [oj + bj, Ok + bk) and the due dates {dj, dk). □ 

According to the two properties, a job should be scheduled in an earlier position if it has a 
smaller value of (or Oi -I- bi if it is deteriorated) and a smaller value of di. There is a weighted 
search algorithm that has applied to solve the single-machine flow time scheduling problem [ll| . 
Thus, we adopt this idea and provide a simple weighted search procedure (SWSP) to obtain a 
heuristic for the 1 \pj ~ Oj or aj + bj , /ij | problem. 

3.1. Simple weighted search procedure 

We shall need an appropriately chosen triple uj :— (wi, a;2, wa) of positive weights to compute 
a weighted value mi := L0idi+uj2Pi+i-03hi, for each i N. Since it is difhcult to determine a priori 
a triple of weights that can yield good solutions, we adopt the dynamic update strategy to search 
all possible triples uj. Weight uji is a linearly increasing weight, given by coi = wimin -I- (wimax — 
wimin)(^i — l)/!"- ~ 1); whcrc li varies from 1 to n. Weight L02 adopts the same updating formula 
as weight uji . The only difference between the two weights is their possible minimal and maximal 
values. Suitable values of wimin, i^imax, 1^2 min and W2max may be determined by preliminary 
experiments. For example, for the numerical experiments we conducted in this article, we have 
chosen the values of the four parameters chimin, wimax, ^^2111111 and W2max to be 0.2, 0.9, 0.1 and 
0.7, respectively. With ioi and uj2 determined, W3 := 1 — wi — i02. But W3 may become negative 
by using this formula. Should a negative uj^ occurs, it is adjusted to a pre-specified positive 
value. In this article, this preset value is chosen to be 0.1. Let ft be the set of all possible triples 
of weights obtained. 
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We now describe the SWSP. Firstly, let a triple (wi, a;2, wa) e 57 be fixed. Then the job 
with the minimal due date is scheduled in the first position. Subsequently the unscheduled 
jobs are arranged in a nondecreasing order of the weighted sums rrii, i ^ N. Thus each triple 
(wi, a;2, wa) G is associated with a schedule. Correspondingly, for each schedule, the value of 
the objective total tardiness is calculated. Among all these different solutions, the best solution 
is given by the one with the smallest total tardiness. Furthermore, in order to refine the quality 
of the solution, a local improvement approach based on pairwise swapping of jobs is used in the 
procedure. The detailed SWSP is described in Algorithm [TJ 



Algorithm 1 Simple weighted search procedure (SWSP) 
1: Input the initial data of a given instance; 
2: Set C[o] = 0, A^o = {1, • • • 7"} and tt = [ ]; 

3: Generate the entire set fl of possible triples of weights. For each triple (101,102,^3) £ ^, 

perform the following steps; 
4: Choose job i with minimal due date to be scheduled in the first position; 
5: C[i] = C[o] + fli, TT = [tt, i]; 
6: delete job i from Nq; 
7: set fc = 2; 
8: repeat 

9: if C[fc_i] > ma.x{hr,r G Nq} then 

10: choose job j from A'o with the smallest weighted value nij to be scheduled in the fcth 
position; 

11: C[fe] = C[fc_i] + Gj + bj, TT = [tt, j]; 
12: delete job j from Nq\ 
13: fc = fc + l; 
14: else 

15: choose job j from A^o with the smallest value rrij to be scheduled in the fcth position; 
16: if C[fc_i] > hj then 

17: C[fc] = C[fc„i] + flj + bj] 

18: else 

19: C[fe] = C[fe„i] + af, 

20: end if 

21: vr ^ [tt, j]- 

22: delete job j from Nq\ 

23: end if 

24: until the set Aq is empty 

25: calculate the total tardiness Z{-k) of the obtained schedule tt; 
26: for i ^ 1 to n do 
27: for j 1 to n do 
28: if i ^ j then 

29: create a new solution tt' by interchanging jobs in the ith and jth position from tt; 

30: replace tt by tt' if the total tardiness of tt' is smaller than that of tt; 

31: end if 
32: end for 
33: end for 

34: Output the finial solution tt. 
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3.2. General variable neighborhood search heuristic 

The variable neighborhood search (VNS) is a simple and effective meta-heuristic proposed by 
Mladenovic and Hansen (25| . It has the advantage of avoiding entrapment at a local optimum by 
systematically swapping neighborhood structures during the search. The basic VNS combines 
two search approaches: a stochastic approach in the shaking step that finds a random neighbor 
of the incumbent, and a deterministic approach which applies any type of local search algorithm. 
Serval VNS variants have been proposed and successively applied to numerous combinatorial 
optimization problems [Ifl]. Among which, the variable neighborhood descent (VND) [9] as the 
best improved deterministic method is the most frequently used variant. The VND initiates from 
a feasible solution as the incumbent one and then carries out a series of neighborhood searches 
through operators A4,(fc = 1, • ' ' j ^max)- If a better solution is found in a neighborhood, the 
incumbent solution is replaced by the better one and the search continues within the current 
neighborhood; otherwise it will explore the next neighborhood. The obtained solution at the end 
of the search is a local optimum with respect to all neighborhood structures. If the deterministic 
local search approach of the basic VNS is replaced by the VND search, the resulted algorithm is 
called a general VNS (GVNS). The GVNS has received attentions and showed good performance 
compared to other VNS variants. So far, the GVNS has been applied to many optimization prob- 
lems, such as the incapacitated single allocation jp- hub median problem (l2| . the one-commodity 
pickup-and-delivery traveling salesman problem f26j, the capacitated vehicle routing problem [23] 
and the single-machine total weighted tardiness problem with sequence dependent setup times 

As far as we know, there is no published work on solving scheduling problems with dete- 
riorating jobs by the GVNS. Therefore, in this section we develop a GVNS heuristic for the 
single-machine total tardiness scheduling problem with step-deterioration. In what follows, the 
main components of the designed GVNS algorithm are described: the initialization process, five 
neighborhood structures provided for the shaking step and local search procedures. In addition, 
a perturbation phase with a 3-opt operation without change of direction is embedded within the 
search process in order to decrease the probability of returning to the previous local optimum. 

3.2.1. Initialization 

Typically, a good initial sequence can be obtained by using the Earliest Due Date (EDD) 
rule. That is to say, all jobs are arranged in nondecreasing order of the due dates. 

3.2.2. Neighborhood structures 

In a local search algorithm, a neighborhood structure is designed by introducing moves from 
one solution to another. In order to conduct a local search in the proposed GVNS, we next develop 
five neighborhood structures based on swap, insertion and fc-opt for the problem \\pj = Qj or 
+ I I S ■ These neighborhood structures are defined by their corresponding operators. 
We remark that for simplicity a neighborhood structure shall be referred to by the name of its 
corresponding generating operator. For example, if a neighborhood structure is generated by an 
operator A/i, the neighborhood structure shall be called Afi neighborhood structure or simply 
Afi neighborhood. 

Swap Operator {Afi ) : The swap operator (Figure 13. ip selects a pair of jobs ir.i and iTj in 
the current sequence tt of jobs, exchanges their positions, and computes the total tardiness 
of the resulting solution. If an improvement is found, the new sequence is accepted as the 
incumbent one. The operator repeats this process for all indices i,j G N , with i ^ j until all the 
neighborhoods have been searched. The size of the swap operator is n(n — l)/2. 

Insertion Operator (A/2): For a given incumbent arrangement of jobs, the insertion neigh- 
borhood (Figure 13. 2[) can be obtained by removing a job from its position and inserting it into 
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Figure 3.1: Illustration of the swap operator 




Figure 3.2: Illustration of the insertion operator 



another position. All jobs are considered for insertion operation. Once an improvement is ob- 
served, the new arrangement of jobs is deemed as the incumbent one. 

Pairwise Exchange Operator (As): The pairwise exchange operator is similar to the swap 
operator except that the swap is applied to a pair of jobs rather than a single job. In our 
implementation, these pairwise jobs are selected from all the combinations of two out of n jobs. 
It exchanges their positions and computes the total tardiness of the resulting sequence. Once an 
improvement is obtained, the incumbent solution is updated by the new solution. 

Couple Insertion Operator (Afi)'- This procedure is similar to the insertion operator A/2- But 
the operation is for a pair of successive jobs. For each couple of jobs tt.; and tt^+i, 1 < i < n — 1, 
the operator extracts these two jobs and inserts them in another pair of positions j and j + 1, 
1 < j < n - 1- Note that i ^ j. 

2-opt Operator (TV's): The 2-opt is the most classical heuristic for the traveling salesman 
problem in which it removes two edges from the tour and reconnects the two paths created. In 
our implementation (Algorithmic]), the 2-opt operator selects two jobs tt^ and ttj in the current 
sequence. It then deletes the edge connecting job tt^ and its successor and the edge connecting 
job TTj with its successor. Afterwards, it constructs a new connection of tt^ to ttj and a new 
connection between their respective successors. Furthermore, the partial sequence between the 
successors of tt.^ and ttj is reversed. Figure 13.31 illustrates an example of the 2-opt procedure. 
When an improvement is found in terms of the objective value, the incumbent is updated with 
the improved sequence. The search continues with applying the 2-opt operator to all possible 
pairs of jobs that are at least three positions away from each other. The solution obtained by 
this operator may not significantly differ from the incumbent in terms of the objective values. 
But some random jumps in the objective value may be achieved to escape from a current local 
optimum due to the path reversion. 

3.2.3. Shaking and local search 

A shaking operation is performed before the local search in each iteration. The shaking 
procedure plays a role in diversifying the search and facilitating escape from a local optimum. 
To preserve the simplicity of the principles of the VNS, both the shaking procedure and the local 
search of the GVNS make use of the same set Mk (^=1,- ■ • , 5) of neighborhood structures. The 
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Algorithm 2 2-opt Operator (TVs) 
1: for i ^ 1 to n do 
2: for j ^ 1 to ri do 
3: / min(i, j); 
4: J ^ max(i, j); 
5: if J - / ^ 3 then 

6: apply the 2-opt procedure to the jobs tt^ and ttj to generate a new sequence tt'; 

7: if the new sequence tt' is better than the current sequence in terms of objective value 

then 

8: update the incumbent; 

9: end if 

10: end if 
11: end for 
12: end for 




Figure 3.3: Illustration of the 2-opt operator (Ms) 



shaking operation is implemented by generating randomly a neighboring solution tt' of the current 
one TT using a given neighborhood operator Afk- The neighborhood operator A/fe will be chosen 
to cycle from A/i through As . If the given neighborhood structure is Afi or A/5 , then the shaking 
procedure randomly selects two jobs. If the given neighborhood structure is A/2, then the shaking 
procedure randomly selects a job and an insertion position. If the given neighborhood structure 
is A/3, then the shaking procedure randomly selects two pairs of jobs. If the given neighborhood 
structure is A/4, then the shaking procedure randomly selects a couple of two consecutive jobs 
and a couple of two consecutive positions. 

A complete local search is organized as a VND using the proposed neighborhood structures. 
To efficiently explore possible solutions, a sequential order K of applying these neighborhoods are 
randomly generated. For instance, assuming that the sequence is if = (3,1,2,5,4), the search 
starts from A/3 and ends at A/4. For each neighborhood, a new local optimum tt" is obtained by 
carrying out the corresponding local search operation. If tt" is better than tt', the new solution 
tt" will be accepted as a descent so that tt' is updated with tt", and the search continues for a 
new tt" within the current neighborhood; otherwise the search turns to the next neighborhood in 
K. The search stops until the last neighborhood in K is explored. It is worthwhile to point out 
that after one iteration of a shaking and local search, the solution tt' generated by the shaking 
procedure may not be improved. 

The shaking and local search steps are summarized below. 

1. Begin the shaking procedure. Use the current solution n to randomly generate a neighbor 
tt' and set i = 1. 

2. Obtain the sequential order K of neighborhood search at random. 
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Figure 3.4: Illustration of the 3-opt moves (A/s) 



3. Apply the neighborhood operator MkH) to tt' to achieve a local optimum tt", where K{i) 
means the i-th entry of the sequence K. 

4. If tt" is better than tt', update tt' and keep the value i so the search will continue within 
the current neighborhood; otherwise, i (i + 1). 

5. If I > fciiiax = 5, complete one iteration of the shaking and local search; otherwise, go to 
Step 3. 

3.2.4- Perturbation phase 

Since a local search applied to optimization problems often suffers from getting trapped in 
a local optimum, the well-know approach for this deficiency is to adopt a multi-start method 
when no improvement is observed. Multi-start heuristics can usually be characterized as iterative 
procedures consisting of two phases: the first phase in which a starting solution is generated and 
the second one in which the starting solution is typically (but not necessarily) improved by local 
search methods. However, a far more effective approach is to generate the new starting solution 
from an obtained local optimum by a suitable perturbation method. 

Inspired by the multi-start strategy, we provide a perturbation phase with 3-opt operator 
without change of direction for producing a new starting solution in case a local search is trapped 
in a local optimum. In our implementation, if the current solution tt cannot be further improved 
through a predetermined number 7 of iterations of the shaking and local search procedures, the 
GVNS algorithm assumes that there is no hope to continue the local search based on the current 
best solution tt. Then, the 3-opt operator (Figure 13. 4p is implemented on tt. Three jobs are 
randomly selected from the incumbent sequence. The 3-opt operator removes the three edges 
connecting the selected jobs with their successors. Then it reconnects the four subsequences 
created. The direction of these subsequences remains unchanged because reversing the direction 
of these subsequences may produce a much worse solution after a number of local searches. 

3.2.5. Proposed GVNS algorithm 

The GVNS algorithm starts with an initialization phase in which an initial solution ttq is 
generated by the EDD rule and is set as the current solution tt. To evaluate the quality of 
solutions, the solution value is considered as the total tardiness. 

At each iteration, the proposed algorithm needs to carry out mainly two steps. First, a 
shaking procedure is performed to generate a random neighboring solution tt' of the incumbent 
solution TT. Subsequently, a local search based on the VND with tt' as the input solution is 
performed in an attempt to improve tt' . The local solution tt', possibly improved by the local 
search is then compared to the current best solution tt in terms of the objective function value. 
If tt' is better than tt, the current solution tt is updated by tt' . This completes one iteration of 
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the shaking and local search. The GVNS algorithm then continues with next iteration of shaking 
and local search. In addition, if no improvement of the current best solution tt can be found 
through a predetermined number 7 of iterations of shaking and local search, a 3-opt perturbation 
procedure is used to generate a newly starting solution tt. 

We next describe the stopping criterion. A pre-specifled maximum number Iter-a^ax of itera- 
tions of shaking and local search or a maximum number IteVnip between two iterations without 
improvement are used as the stopping criterion of the algorithm. In our implementation, we 
choose Iter^sx — 500 and Iter-aip = 150, respectively. Moreover, the predetermined number 7 
of iterations to perform a 3-opt perturbation is chosen to be 7 = 0.5 • Iter^ip- This strategy is 
determined by our preliminary experiments. A Pseudo-code of the proposed GVNS algorithm is 
summarized in Algorithm |31 



Algorithm 3 General variable neighborhood search heuristic 
1: Initialize the parameters of the algorithm; 

2; Define a set of neighborhood structures A4(fc — 1, . . . , 5), that will be used in the shaking 

phase and the local search phase; 
3: Generate the initial solution ttq by the EDD rule; 
4: Calculate the objective value /(ttq) for the solution ttq; 
5: Set the current best solution tt = ttq; 

6: Choose the stopping criterion; initialize the counter: iteri = 0, iter2 — and iter^ — 0; 
7: Set the first neighborhood structure for the shaking procedure to be fc <— 1; 
8: repeat 

9: Shaking: Generate a point vr' at random in the Afk neighborhood of tt; 
10: Produce a random sequence K of applying the 5 neighborhood structures; 
11: Local search: Apply the VND scheme in the order specified by K, update tt' if a better 

local optimum is obtained; 
12: if /(tt') < /(tt) then 

13: TT 4~ tt' 

14: reset the counter iter 2 — 0; 
15: reset the counter iter^ = 0; 
16: else 

17: Increment the counters: iter2 = iter2 + 1, iter^ = iter^ + 1; 
18: end if 

19: Update the counter of total number of iterations iteri = iteri + 1; 

20: if TT has not improved for a given number of iterations 7, that is, when iter^, > 7, and if 
iter2 < iter^ip then 

21: use the 3-opt perturbation procedure to generate a new starting solution tt; and reset 

iter^ — 0; 
22: end if 

23: Set k — k mod 5 -f- 1 to cycle through the neighborhood structures for shaking. 
24: until the stopping criterion is met, that is, iteri > -^ie^'max or iter2 > Iter^ip; 
25: Output the current best solution tt. 



4. Computational experiments 

In this section, in order to evaluate the performance of the GVNS algorithm and the proposed 
heuristic SWSP, a set of testing instances were generated and solved on a PC with Intel Core 13 
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3.20 GHz CPU and 4 GB of memory in the environment of Windows 7 OS. The procedure of 
generating the testing instances and analysis of the results are described below. 

4-.1. Experiments design 

In this article, the basic processing times (aj) are randomly generated from a discrete uniform 
distribution on the interval (0, 100]. The deteriorating dates (hj) are picked from the uniform 
distributions over three different intervals (0, A/2], [A/2, A] and (0, A], where, the value of A 
is obtained from the equation A = ^j^N^i- "^^^ deterioration penalties bj,j S N, are drawn 
from the uniform distribution (0, lOOxr], where we choose t=0.5. In addition, the due dates are 
randomly generated according to a discrete uniform distribution from two different intervals (0, 
CSxCmax], and (OjCrnax], whcrc Cmax IS the valuc of the makespan obtained by arranging the 
jobs in the non-decreasing order of the ratios aj/bj, j d N 

The algorithms were tested over five different job sizes for small-sized instances. Those sizes 
are respectively n= 8, 10, 15, 20 and 25. For all possible combinations of deteriorating dates 
and due dates, to account for the three intervals in which deteriorating dates are generated and 
the two intervals in which due dates are drawn, six types of problems are needed to solve for a 
specific job size. For convenience, these types of problems are denoted by symbols S_kik2. For 
example, S'_12 represents a type of problems with deteriorating dates drawn from the interval (0, 
A/2\ and due dates drawn from the interval (0,Cinax]- In addition, a set of large sized instances 
with n={50, 60, 70, 80, 90, 100} are being considered. As a consequence, for both small-sized 
and large-sized problems, 66 ((5 + 6) x 6) sample instances were randomly generated. 

4-2. Experimental results 

Because there are no comparative data and no competing heuristic for our problem, compar- 
isons with best know solutions are not possible. Thus, we have designed and coded the standard 
VNS heuristic (Algorithm 0]) as a comparison to assess our approach. The VNS heuristic does 
not include the perturbation phase. The implementation sequence of neighborhoods is chosen by 
the deterministic order ( A/i , 7\/2 , As , 7V4 and A/5). The stopping criteria are chosen to be identical 
to the GVNS algorithm. 

The described problem can be solved optimally by a commercial solver CPLEX 12.5 for some 
small-sized instances. However, because of its NP-hardness, it is impossible to obtain optimal 
solution by the CPLEX for medium or large instances. The preset run time for CPLEX is 
one hour. If CPLEX fails to either converge to the optimum or prove the optimality of the 
incumbent within the time limit, a GAP is provided by the software. The GAP shows the 
quality of a solution given by the CPLEX within the run time limit to some extent. A large 
GAP implies that the CPLEX needs more time to converge to an optimal solution. 

All proposed algorithms are implemented in Matlab 7.11. The CPLEX and the SWSP are 
deterministic hence only one run is necessary for each problem instance. While the VNS and 
the GVNS are stochastic so we have to run some replications in order to better assess the 
experimental results. In our experiment, for each instance we run 10 times when using the VNS 
and the GVNS. 

Each algorithm's performance is measured by computing a relative percentage deviation 
(RPD) defined by the equation 

RPD{%) = ^^'g - ^be^t ^ ^^^^ 
^bcst 

where Zaig is the solution value obtained for a given algorithm and instance, Zbost is the best 
solution of all approaches. For the VNS and the GVNS, the comparison results are in terms of 
average RPD and average computational time. 
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Algorithm 4 Variable neigliborhood searcli lieuristic 
1: Initialize the parameters of the algorithm; 
2: Define a set of neighborhood structures Nk:k = 1, . . . , 5; 
3: Generate an initial solution ttq by the EDD rule; 

4: Set the current best solution tt = ttq; initialize the counters: iteri — 0, iter2 — 0. 
5: fc -s- 1; 
6: repeat 

7: Shaking: Generate randomly a point tt' in the A;th neighborhood of tt; 

8: Local search: Apply neighborhood search operator Mk with tt' as initial solution to obtain 

a local optimum tt"; 
9: if /(tt") < /(tt) then 
10: TT ^ tt"; 

11: continue the local search with the current neighborhood Mk] 
12: reset the counter iter2 = 0; 
13: else 

14: fc ^ A: mod 5 + 1; 

15: Increment the counter: iter2 = iter2 + 1; 
16: end if 

17: Update the counter of total number of iterations iteri — iteri + 1; 

18: until the stopping criterion is reached, that is, iteri > Iter-a^gj^ or iter2 > Iter^ip; 

19: Output the current best solution n. 



Table □ summaries the results obtained from the CPLEX, the SWSP, the VNS and the GVNS. 
As shown in the table, the GVNS finds the best solutions for all small-sized instances. Since 
the computational time of the CPLEX was preset to one hour, the CPLEX could not find the 
optimal solutions for all instances with 20 or 25 jobs. The computational time of the CPLEX 
exponentially increases as the number of jobs increases due to the NP-hardness of the problem. 
Note that 4 solutions obtained by the CPLEX are worse than those obtained by the GVNS. The 
average RPD given by the SWSP is 11.63%. The run times of the SWSP are very short and are 
ignored in table [TJ Compared to the CPLEX, the run times of the GVNS and the VNS do not 
significantly increase as the number of jobs increases. The computational time of the GVNS is 
longer than that of the VNS because the GVNS includes the VND scheme as the local search 
and additionally the perturbation phase. However, the VNS delivers the best solutions for only 
13 out of the 30 small-sized test instances. The RPD delivered by VNS is only 2.32%. This 
suggests that these designed neighborhood structures are well suitable for solving the problem 
under consideration. 

For large-sized instances, it is impossible to find the optimal solution by using the CPLEX 
within the preset one-hour time limit. Thus we tested the performance of the proposed algorithms 
with respect to the standard VNS. The results are shown in Tabled The average RPD of the 
GVNS is about 0.78% which is significantly smaller than that of the VNS. Except for instance 
S'_12 with 60 jobs, the RPDs of other instances given by the GVNS are very small. The relative 
higher RPD of instance S'_12 may be because its optimal solution value is relatively small and 
there are 2 local optima found in 10 replications. According to figure H7T1 it is observed that the 
quality of solutions delivered by the GVNS is very good without respect to the distribution of the 
deteriorating dates. On the other hand, the quality of solutions obtained by the SWSP is inferior 
compared to the GVNS and the VNS. 

To measure the robustness of the algorithm, a mean absolute deviation (MAD) of 10 runs 
when applying the VNS or the GVNS was calculated for each of large-sized instances according 
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to the equation 



MAD{%) = - 5](Zaig(r) - Zaig) X 100 (4.2) 

X Zalg ^ 

where i? is the number of repUcations, Zaig denotes the average solution value obtained from 
the R runs for a given algorithm, and Zaig(r) indicates the solution value obtained for a given 
algorithm in the r-th run. The average MAD of the GVNS is merely 0.81%. Figure l¥!^ reports 
the MAD obtained by the GVNS for large-sized instances. Overall, the GVNS demonstrates 
to be a good alternative to solve single-machine total tardiness scheduling problems with step- 
deteriorating jobs, because the algorithm finds good solutions in a reasonable computational 
time. 




Figure 4.1: The RPDs given by the GVNS for large-sized instances 



5. Conclusions 

In this article, we considered a single-machine total tardiness scheduling problem with step- 
deteriorating jobs. The objective of this problem is to determine the sequence policy of the jobs 
under consideration so as to minimize the total tardiness. In order to solve the problem, an 
integer programming model was developed. Solutions were obtained by the CPLEX up to the 
size of 25 jobs. Due to the intractability of the problem, it is impossible to solve large instances 
to optimality by using the CPLEX. Based on two properties introduced, a heuristic called the 
SWSP and the GVNS algorithm were proposed to obtain near-optimal solutions of the problem. 
Meanwhile, the standard VNS algorithm was presented as reference for evaluating the perfor- 
mance of our algorithms. Experimental results showed that the proposed GVNS outperforms 
other heuristics in terms of relative percentage deviation from the best solution for both small- 
and large-sized instances. The computational times are in general short for the GVNS and the 
VNS. The GVNS performed better than the VNS in both cases. Furthermore, the GVNS is more 
robust than the VNS with regards to the choice of different intervals of deteriorating dates. 
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Figure 4.2: MAD given by the GVNS for large-sized instances 

For further study, a suggestion is to consider the setup times between different jobs for the 
single-machine scheduhng problem with step-deteriorating jobs. In addition, multi-machine or 
multi-criteria cases with step-deterioration are also encouraged. 
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Table 1: Comparison of the CPLEX, the SWSP, the VNS and the GVNS for small-sized instances. 
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Table 2: Comparison of the SWSP, the VNS and the GVNS for large-sized instances. 
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45880 


0.00 


0.00 


225.04 


90 


57859 


13.55 


51118 


0.32 


0.11 


29.56 


50958 


0.00 


0.01 


406.09 


100 


80275 


11.98 


71975 


0.40 


0.18 


30.83 


71695 


0.01 


0.01 


583.66 


S_22 50 


320 


57.64 


212.1 


4.48 


5.15 


4.77 


203 


0.00 


0.00 


43.82 


60 


1647 


55.23 


1198.3 


12.94 


9.48 


7.88 


1061 


0.00 


0.00 


114.46 


70 


5063 


8.91 


4797.4 


3.19 


1.55 


11.64 


4649 


0.00 


0.00 


152.83 


80 


2535 


34.98 


2161.5 


15.10 


3.05 


17.96 


1878 


0.00 


0.00 


219.78 


90 


11089 


17.18 


9785.6 


3.41 


1.64 


33.16 


9463.1 


0.00 


0.00 


444.46 


100 


3467 


23.34 


3007.8 


7.00 


1.45 


24.15 


2811 


0.00 


0.00 


363.21 


S_2,l 50 


15639 


14.35 


13817 


1.03 


0.35 


7.56 


13676 


0.00 


0.00 


91.41 


60 


31578 


9.49 


28930 


0.31 


0.06 


7.76 


28842 


0.00 


0.00 


143.20 


70 


38983 


19.39 


32953 


0.92 


0.33 


19.41 


32660 


0.02 


0.03 


290.32 


80 


49429 


27.75 


39330 


1.65 


0.41 


27.62 


38725 


0.08 


0.06 


398.79 


90 


75215 


17.39 


64855 


1.22 


0.63 


32.61 


64123 


0.08 


0.06 


623.88 


100 


76221 


21.44 


63412 


1.03 


0.28 


30.48 


62765 


0.00 


0.00 


641.97 


i9 32 50 


1175 


48.92 


1121 


42.08 


3.07 


5.51 


789 


0.00 


0.00 


64.15 


60 


999 


239.80 


688.7 


134.25 


8.09 


8.67 


301.2 


2.45 


0.96 


113.51 


70 


3867 


94.03 


2914.6 


46.24 


7.29 


15.94 


1994 


0.05 


0.05 


244.40 


80 


22127 


21.74 


18782 


3.34 


1.35 


22.28 


18179 


0.02 


0.02 


517.98 


90 


7729 


45.34 


5791.5 


8.90 


2.17 


31.23 


5408 


1.69 


1.20 


647.39 


100 


5061 


162.64 


4207.2 


118.33 


7.05 


34.63 


1955.8 


1.49 


1.18 


540.83 


Average 




174.29 




61.89 


3.33 


20.22 




0.78 


0.81 


347.23 



